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The present invention relates to a method for detenriining geometrical 
properties of a structure of an object displayed in an image. Furthermore, the present 
invention relates to a method for determining a deformable model for adaptation to an 
object, to an image processing device and to a computer program for an image 

10 processing device for determining geometrical properties of an object. 

The present invention relates in particular to the automated measurement 
of geometrical properties of anatomical objects using deformable models in the field of 
medical digital imaging. The increasing availability of 3D medical image data 
improves diagnostics and treatment possibilities dramatically. Due to the size and 

15 complexity of large 3D datasets, automated tools for quantitative measurements are 
important for fast, accurate and reproducible analysis of such image data in daily 
clinical routine. For example, applications include orthopaedic diagnosis and treatment 
(e.g. define and measure geometrical properties of bones in CT), or cardiac imaging 
(e.g. extract the location of specific axes required for scan-plane-planning in MR). 

20 Manual definition and measurement of geometrical properties (e.g. the 

long axis of a femur shaft, the short axis of the left heart ventricle) based on image data 
is time consuming, subjective, and error prone, and therefore not clinically practical. A 
first step towards the automatic measurement is the extraction of the object surface, e.g. 
by adapting a deformable, parametric surface model to the object of interest. Methods 

25 of this kind are known, for example, from J. Weese et al. "Shape constrained 

deformable models for 3D medical image segmentation" 17* International Conference 
on Information Processing in Medical Imaging (IPMI), pages 380-387, Davis, CA, 
USA, 2001, Springer Verlag, and T. Mclnemey et al. "Deformable models in medical 
image analysis: A survey" in Medical Image Analysis, 1(2):91-108, 1996. After initial 

30 placement of the deformable model by an operator with, for example, a mouse, the 
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model is iteratively deformed until it matches the surface of the object to be measured. 
However, often the measurement of geometrical properties cannot readily be derived 
from the complete object surface. For example, the axis of a femur shaft or an angle 
between two vertebral endplates are geometrical properties defined by parts of the 
5 object, which are difficult to specify by a human operator in an accurate and 

reproducible fashion. Such methods are very well adapted to extract the surface of the 
object, providing all necessary information concerning the surface of the object. 
However, there are a great number of measurements of geometrical properties which 
cannot be derived from the object surface. For example, a center of a femur head or an 

10 axis of a femur shaft of the femur are geometrical properties which cannot be directly 
derived from the complete object surface. 

It is an object of the present invention to provide a metihiod for 
detennining geometrical properties of a structure of an object displayed in an image, 
allowing automated measxu-ements of geometrical properties of objects. 

15 In accordance with the present invention, this object is solved with a 

method for determining geometrical properties of a structure of an object displayed in 
an image comprising the steps of adapting a deformable surface model to the object, 
applying additional geometrical information to the adapted deformable surface model of 
the object, and extracting the geometrical properties of the structure of the object from 

20 the adapted deformable surface model to which additional geometrical information has 
been applied. 

According to the present invention, due to the integration of additional 
geometrical information into the deformable surface model, geometrical properties of 
the objects can advantageously automatically be measured. Furthermore, the present 

25 invention allows to derive geometrical properties from a surface of an object which 
have a definition based on sub-parts of the object. For example, the present invention 
allows to automatically extract a center of the femur head, whereas, only the surface of 
the whole f emur is displayed. Due to the integration of additional geometrical 
information, diagnosis and treatment of a patient can be carried out more precisely. 

30 Claim 2 describes an exemplary embodiment of the method of claim 1, 

wherein surface elements belonging to a particular sub-part of the object are identified. 
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Due to the identification of sxirface elements of sub-parts of the object, particular sub- 
parts of the object may be recognized automatically. For example, by identifying 
surface elements in the model belonging to the femur head, a femur head in an unseen 
image can be automatically identified and the boundaries of the femur head can be 
S identified. 

According to the exemplary embodiment of claim 3, geometrical 
properties of the object are derived on the basis of the geometrical primitive. 
Advantageously, this allows a very simple procedure to identify geometrical properties 
of the object which are not based on the surface of the object. For example, the center 

10 of the femur head is identified from coordinates and parameters of the sphere fit to the 
femur head. Advantageously, a computation time is minimized. 

The exemplary embodiment of the present invention according to claim 4 
describes a preferred way to identify surface elements of the deformable model 
belonging to a particxilar sub-part of the object. 

15 Another exemplary embodiment of the present invention in accordance 

with claim 5, relates to a method for determining a deformable model for adaptation to 
an object, allowing the determination of a model which enables the automated 
measurement of geometric properties of objects when applied to an object. 
Furthermore, this method is a simple method for determining a deformable model 

20 which enables a highly accurate adaptation of the model to the object. 

Advantageously, according to another exemplary embodiment of the 
present invention as set forth in claim 6, surface elements belonging to sub-parts of the 
object are selected and labelled. This allows a simple and efficient recoimaissance of 
sub-parts of the object and an identification of surface elements belonging to these sub- 

25 parts requiring a minimized number of calculations when the model is applied to a new 
object in an image. 

According to yet another exemplary embodiment of the present invention 
as set forth in claim 7, a simple method is provided allowing an efficient determination 
of a transformation rule for fitting the geometric primitive into the surface model. 

30 In claim 8, an exemplary embodiment of an image processing device for 

executing the method according to an exemplary embodiment of the present invention is 
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described and claim 9 describes a computer program for such an image processing 
device. 

As apparent jfrom the above explanations and the following description, it 
is the gist of the present invention to integrate additional geometrical information into a 
5 deformable model, which model is then applied to an object displayed in an image, 
wherein, for determining geometrical properties of the structure of the object, the 
additional geometrical information is used. The geometrical properties may be included 
into the model by identifying and labelling sub-parts (e.g. surface elements of a mesh 
such as triangles) of the sxirface model and fitting geometric primitives (e.g. a sphere to 
10 the femur head) to these sub-parts in order to represent the geometrical properties. 
Since the number of svirface elements (here the number of triangle) of a sub-part 
remains constant during adaptation of the surface model to the object, and the triangles 
reach the same anatomical location for individual objects, the adaptation of a label 
deformable model to an unseen image advantageously allows to identify the sub-parts 
15 on the xmseen object surface based on a one-to-one point correspondence between 
original and adapted mesh. 

These and other aspects of the invention will be apparent from and 
elucidated with the reference to the exemplary embodiments described hereinafter. The 
following exemplary embodiments of the present invention will be described with 
20 reference to the Figures. 

Fig. 1 shows a schematic representation of an exemplary embodiment 
of an image processing device suitable for executing an exemplary embodiment 
of the method according to the present invention. 

Fig. 2 shows a flow chart of an exemplary embodiment of a method for 
25 determining an extended deformable surface model according to the present 

invention. 

Fig, 3 shows a flow chart of an exemplary embodiment of the method 
according to the present invention. 

Fig. 4 shows an image of a vertebra model determined with a method 
30 according to an exemplary embodiment of the present invention applied to a 

vertebra. 



wo 2004/010382 PCT/IB2003/003117 

5 . 

Fig. 5 shows an exemplary embodiment of an adaptation of a surface 
model according to an exemplary embodiment of the present invention to an 
im^e of a vertebra and the fitting of a plane to the top endplate of the vertebra 
in accordance with an exemplary embodiment of the present invention. 
5 Fig. 6 shows an exemplary image of a femur head, wherein the surface 

elements belonging to a sub-part of the femur have been labelled, in accordance 
with an exemplary embodiment of the present invention. 

Fig. 7 shows an image of a femur wherein primitives were fit to sub- 
parts of the femxir, in accordance with an exemplary embodiment of the present 
10 invention. 

Fig. 8 shows an image wherein geometric properties of the femur are 
derived firom the geometric primitive, in accordance with an exemplary 
embodiment of the present invention. 

Figure 1 depicts an exemplary embodiment of an image processing 
15 device according to the present invention, for executing an exemplary embodiment of a 
method in accordance with the present invention. The image processing device 
depicted in Fig. 1 comprises a central processing unit (CPU) or image processor 1 
connected to a memory 2 for storing a deformable model and an image depicting an 
object The imagis processor 1 may be connected to a plurality of input/output-, . . 
20 network- or diagnosis-devices such as an MR device or a CT device. The image 

processor is fiirthermore connected to a display device 4 (for, e.g. a computer monitor) 
for displaying information or images computed or adapted in the image processor 1 . An 
operator may interact with the image processor 1 via a keyboard 5 and/or other output 
devices which are not depicted in Fig. 1 . 
25 Figure 2 shows a flow chart of an exemplary embodiment of a method 

for determining an extended deformable model for adaptation to an object in accordance 
with tiie present invention. After an initialisation in step 50, in step 5 1, a surface model 
of the object wherein flie surface model describes a surface of the object is generated. 
According to the present exemplary embodiment, the surface is represented by a 
30 polygonal mesh, where vertices Xj are connected with edges. Here, a triangular mesh is 
used, but other representations such as simplex or general polygonal meshes are 
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possible. The siirface representation can be derived by a common triangulation method 
of a simple training object, for example as suggested by W,E. Lorensen et al. "Marching 
cubes: A high resolution 3d surface construction algorithm" Computer Graphics, 21(3): 
163-169, 1987. Instead of a single surface triangulation, it is also possible to iise a 
5 statistical shape model, such as suggested by T.F. Cootes "Active shape model- *smart 
snakes', in British Mach. and Vision Conf. , pp. 266-275, 1992. 

After generating the surface representation, i.e. the deformable siirface 
model, additional geometric properties are integrated into the deformable surface model 
in step 52. 

10 Step 52 comprises a step 53 wherein surface elements belonging to sub- 

parts of the object are identified. If the example of a femur is used, sub-parts of the 
femur are for example a femur head, a femur shaft etc. The sub-parts, i.e. the 
subdivision of the object into sub-parts, depends on which measurements are of interest. 
If, for example, a center of the femur head is of interest, preferably the femur is sub- 

15 divided into a femur head and a femur shaft. Then, in a following step 54, surface 

elements of the surface model, i.e. the triangles of the mesh, are labelled in accordance 
with the respective sub-part of the object to which they belong. As label, for example, 
integer numbers can be attached to the respective triangles. The triangles are labelled 
such that all triangles belonging to the same sub-part have the same label. This can for 

20 example be carried out by a physician with an interactive display and a pointing and 
selection device or with a corresponding selection method. However, it is also possible 
to use a pattem recognition algorithm for identifying and labelling sub-parts of the 
object for the geometric property to be measured. 

Then, in step 55, a suitable geometric primitive is selected in accordance 

25 with the measurement to be carried out and a form of the respective sub-part. For 
example, when the center of the femur head is to be determined, a sphere is selected. 
Also, when the axis of the femur shaft is to be detected, a straight line is selected as 
geometrical prinoitive. This can be done by a physician or a suitable pattem recognition 
method. 

30 Then, in step 56, the geometric primitive is fit into the surface model, i.e. 

the geometric primitive is fit to the surface elements of the respective sub-part of the 
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object. The primitive can be fitted to the triangles of the mesh labelled as belonging to a 
particular sub-part, by for example minimizing orthogonal distances between the 
triangle coordinates and the primitive surface in the least-square sense. Examples for 
such fitting methods are described in D. Eberly, "Least squares fitting of points", 
5 Technical report. Chapel ffiU, NC, USA, 2001 and H. Hoppe et al., "Surface 
reconstruction from unorganized points'' Computer Graphics (SIGGRAPH '92 
Proceedings), 26(2):71-78, 1992. 

Then, in a step 57, a rule is determined for mapping the geometric 
primitives onto the sub-parts. In the present exemplary embodiment, the rule consists of 

10 the particular primitive for the particular sub-part and of the method for fitting the 
primitive to the sub-part. 

Then, after the execution of step 52, which comprises steps 53-57, the 
method continues to step 58, where it ends with a finished extended deformable surface 
model. In distinction to known deformable surface models, this extended deformable 

15 surface model comprises additional geometrical information relating to, for example, 
which triangles of the surface mesh belong to a particular sub-part of the object of 
interest, which primitive fits to the form of this particular sub-part and which method is 
to be used for fitting this primitive to the particular sub part. 

In the following, with reference to the flow chart of Fig. 3, an exemplary 

20 embodiment of the method for determining geometrical properties of a structure of an 
object displayed in an image, in accordance with the present invention is described. 
After initialisation in step 100, in a step 101, an extended deformable model in 
accordance with the structure of the object in the image I containing the structure of 
interest is loaded. The extended deformable model M is described as M(Xi, Si, R) and 

25 may have been determined in accordance with the flow chart described with reference to 
Figure 2. 

In the following steps 102 and 103, an adaptation procedure is carried out 
that results in varying the positions of the deformable surface model, so that it 
optimally fits the surface of the object of interest in the image. Procedures for adapting 
30 the deformable surface model to the surface of the object are known for example from J. 
Weese et al. "Shape constrained deformable models for 3D medical image 
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segmentation" 17* International Conference on Information Processing in Medical 
Imaging (IPMI), pages 380-387, Davis, CA, USA, 2001, Springer Verlag or from T. 
Mclnemey et al. "Deformable models in medical image analysis: A survey" in Medical 
Image Analysis, 1(2):91-108, 1996, 
5 The method of Weese et al. can be summarized as follows: In step 102, 

for each of the triangles, a search along the triangle normal is carried out to find a point 
Xi that potentially lies on the boundary of the object in the image. From these surface 
points, an energy function is formulated. A minimization of the energy is carried out in 
step 103. The results are found vertex coordinates which reflect a tradeoff between 

1 0 being close to the boimdary points and staying similar to the initial deformable model. 
From these new triangle coordinates, new bo\mdary points are searched for in step 102, 
and so forth. Steps 102 and 103 are iterated a fixed number of times, leading to a 
deformed model close to the surface of the obj ect of interest. 

In the following steps 104 and 105, the actual measurement of the 

1 5 geometric properties of the object is carried out. 

In step 104, a subset of vertices or triangles Xi is extracted that defines the 
geometrical measurement to be carried out This will be described with reference to the 
exemplary images shown in Figs. 4 and 5. Fig. 4 shows a vertebra to which the 
extended deformable surface model has been applied and Fig. 5 is an image showing the 

20 surface mesh of the extended deformable surface model and the primitive, here a plane, 
fit to the top endplate of the vertebra. In the example shown in Figs. 4 and 5, a position 
or orientation of the plane of the vertebra end plate is to be measured. Therefore, 
triangles that belong to top of the vertebra endplate are extracted, i.e. identified. 

During adaptation of the deformable model to the object in steps 102 and 

25 103, all triangles reach the same geometric location on the object, as on the training 
object This means, a triangle that was located on tiie top endplate of the model before 
adaptation, will always be on the top endplate after adaptation to the new object Also, 
the number of triangles that belong to the particular sub-part, here to the top endplate, 
remains constant during adaptation. These two facts together are called "one-to-one 

30 point correspondence" between original and adaptation. 

Due to the one-to-one point correspondence, when applying the extended 
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deformable surface model determined in accordance with the method described with 
reference to Fig. 2, the triangles belonging to a particular sub-part of the objects can be 
easily recognized. By tiiis, an automatic recotmaissance of sub-parts of the object, such 
as the top endplate of a vertebra, is possible. In detail, in step 104, information relating 
5 to which triangles are part of the surface of which sub-part is applied as additional 
geometrical information to the surface model which has been adapted to the surface of 
the object in the image. This additional geometrical information is applied to the 
adapted deformable surface model by using the labels of the triangles which are part of 
the extended deformable surface model. As shown with the darker surface of the top 

10 endplate in Fig. 4, all triangles of the surface mesh adapted to the surface of the object 
which belong to the top endplate of the vertebra where identijBed. Then coordinates of 
these labelled triangles are determined. 

This step 104 advantageously allows to automatically identify particular 
sub-parts of an object in a new image. This ability significantly facilitates the work of a 

15 physician. For example, in complex structures such as the brain, particular parts thereof 
can be recognized more easily and more accurately. This ability is also useful for the 
planning and rapid prototyping of prostheses, e.g. of femur prostheses. 

Having extracted coordinates of the triangles of a particular sub-part, the 
method continues with step 105, where parameters representing geometric properties 

20 are estimated. In the examples of Figures 4 and 5, the parameters representing the 
geometric properties are a point pi i and the normal p^ of the plane jBt to the top 
endplate of the vertebra. To do this, additional geometrical information, here the rule 
relating to a particular geometric primitive and a method for fitting the geometric 
primitives to the coordinates of the labelled triangles is applied to the deformable 

25 surface model which was adapted to the surface of the object in the image. 

The rule for estimating these parameters, given the coordinates of the 
triangles is given by the extended deformable model loaded in step 101 . As already 
indicated above, the rule consists of a particular geometric primitive (here a plane) and a 
method for fitting the geometric primitives to the coordinates of the labelled triangles. 

30 Then, in step 105, the respective geometric primitive, here the plane, is 

fit to the coordinates of the labelled triangles belonging to the top end plate of the 
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vertebra, by, for example, minimizing the orthogonal distances between the triangle 
coordinates and the surface of the geometrical primitive in the least-square sense. 

After the orthogonal distances are minimized, coordinates of a point pn 
and the normal pi2 of the plane are known, which may be output as the geometric 
5 properties. 

In brief, according to the method described with reference to Fig. 3, a 
deformable surface model as known in the art is adapted to the surface of the object of 
interest in the image. This means that positions of triangles of a surface mesh are altered 
until the triangles "lie" on the surface of the object. Then, additional geometrical 

10 information is applied to the adapted surface mesh: The triangles belonging to a 
particular sub-part of the object are identified, e.g. labelled with a respective integer 
number, and the geometrical primitive is fit to the labelled triangles. The geometrical 
primitive and the method for fitting the geometrical primitive to the labelled triangles 
are part of the extended deformable surface model loaded in step lOL On the basis of 

15 the coordinates of the fitted primitive and the properties of the primitive, the desired 
geometrical properties are determined. 

Figures 6, 7 and 8 show another example for automated geometric 
measurements in accordance with an exemplary embodiment of the present invention. 
In Fig. 6, an extended deformable model determined in accordance with the present 

20 invention was applied to an image of a femur. In the extended deformable model, the 
femur head was labelled, the femur neck was labelled and the beginning of the shaft was 
labelled. Thus, due to the one-to-one point correspondence between original and 
adapted mesh, the femxjr head is identified and all siuface elements of the mesh 
belonging to the femur head are labelled with the same label and recognized 

25 automatically. Also, the femur neck and the femur shaft were automatically identified 
and all surface elements belonging to tibe femur neck and the femur shaft were labelled 
accordingly. 

In Fig. 7, in accordance with the rule formulated in the deformable 
model, suitable primitives were fit to the respective surface elements labelled in 
30 accordance with the respective sub-part. Here, a sphere was fit to the surface elements 
of the femur head, a straight line was fit to the respective surface elements of the femur 
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neck and another straight line was fit to the surface elements belonging to the femur 
shait. 

Then, here indicated with Fig. 8, automatically, a center of the femur 
head, a direction location of the axis of the femur neck and a location and orientation of 
5 the femur shaft can be derived directly from the two straight lines and the sphere by just 
using the parameter of these primitives. 

Accordingly, the present invention enables the extraction of geometric 
properties of an object which are not directly defined by the surface of the object. 

Exemplary embodiments of the above methods and device may 
10 advantageously be used for orthopaedic diagnosis and treatment (for example, to define 
and measure geometric properties of bones etc.) or cardiac imaging (for example, 
exacting the location of specific axes required for scan-plane-planning in MR). 



